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This  research  was  performed  to  determine  the  characteristics  which 
best  predict  success  among  potential  Air  Force  Institute  of  Technology 
(AFIT)  Department  of  Systems  Management  students.  If  the  implementation 
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dent will  fail  to  attain  his  degree,  my  efforts  will  have  been  worthwhile, 
both  for  the  Air  Force  and  the  prospective  student. 

In  an  effort  to  provide  a useful  document  as  opposed  to  an  academic 
exercise,  I have  attempted  to  write  this  report  in  plain  English  to  the 
maximum  possible  extent.  However,  the  statistical  techniques  and  results 
essential  to  the  discussion  are  included. 

I wish  to  express  my  gratitude  to  Or.  Michael  Stahl  for  suggesting 
this  study  and  providing  his  aid  and  encouragement,  and  to  Dr.  Charles 
McNichols  for  helping  me  overcome  computer  related  problems.  Additionally, 
I would  like  to  thank  Mr.  Harold  Lillie  and  Lieutenant  Colonel  Gerald 
Malicki  of  the  AFIT  Directorate  of  Admissions  for  freely  providing  the 
information  without  which  this  research  would  not  have  been  possible. 
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ABSTRACT 

i'  'T'/a  j,  /'  ■ L ' , 
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This  research  was  conducted  to  investigate  the  prediction  of^success 
among  Systems  Management  and  Operations  Research  Master’s  degree  students. 

A total  population  of  223  male  United  States  Air  Force  tUSAF)  officers 
who  attended  AFIT  from  1971  through  1976. was  analyzed. 

Graduate  grade  point  average  (GGPA)  prediction  was  investigated  using 
multivariate  regression  analysis,  and  success  based  on  degree  receipt  or 

M s -T 

nonreceipt  was  examined  through^ the  application  of  the  Automatic  Interac- 
tion Detection  algorithm  and  discriminant  analysis.  The  predictor  vari- 

f'  - ^ .j  - 

ables  examined  included  not  only'ability  and  biographical  da tai^-buti  several 
surrogate  measures  of  motivation  toward  degree  achievement, as  well. 

The  results  of  the  GGPA  study  confirmed  ^ findings  of  previous 
researchers  that  students  in  different  disciplines  should  not  be  combined 
for  GGPA  predictive  purposes,  and  also  indicated  that  the  GGPA  predictive 
power  attainable  is  modest,  Additionally,  tJje  use  of  GGPA  as  a criterion 
of  academic  success  is  of  questionable  value.  Most  significant  was  the 
finding  that  student  selection  criteria  truncate  from  the  population  those 
persons  who  lack  the  ability  to  achieve  a degree,  and  that  the  motivational 
measures  were  the  best  predictors  of  degree  receipt. 


SUCCESS  PREDICTORS  FOR  STUDENTS  TO  ATTEND 
AFIT  DEPARTMENT  OF  SYSTEMS  MANAGEMENT  MASTER'S  DEGREE  PROGRAMS 

I.  INTRODUCTION 


The  U.S.  Air  Force,  like  civilian  industry,  has  a continuing  require- 
ment for  managerial  and  technological  employees  who  possess  a deep  and 
current  understanding  of  the  knowledge  in  their  particular  field.  This 
requirement  has  led  both  industry  and  the  Air  Force  to  the  conclusion 
that  the  sponsorship  of  Master's  degree  students  is  not  only  desirable, 
but  essential  to  the  success  of  the  organization. 

However,  the  decision  to  allow  an  officer  to  attend  an  Air  Force 
Institute  of  Technology  (AFIT)  Master's  degree  program  represents  a large 
investment.  His  education  is  almost  totally  Government  funded  and  includes 
not  only  school  expenses,  but  the  cost  of  his  move  to  Wright-Patterson  Air 
Force  Base,  Ohio  and  his  normal  salary  for  15  or  18  months,  depending  on 
field  of  study,  as  wel 1 . 

The  program  can  prove  costly  to  the  degree  candidate  in  other  ways. 
Although  there  is  frequently  no  overt  stigma  attached  to  failure  to  obtain 
the  advanced  degree,  the  student  has  lost  the  time  he  could  have  more 
effectively  spent  in  improving  his  promotabil ity  in  other  ways  (such  as 
gaining  added  job  experience). 

Thus,  the  reduction  of  the  number  of  degree  nonrecipients  would  bene- 
fit both  the  Air  Force  and  the  individual  student.  Although  only  10.3 
percent  of  the  candidates  in  the  population  investigated  failed  to  obtain 
a Master's  degree,  it  is  felt  that  improvement  is  both  possible  and  highly 


The  research  reported  on  in  this  thesis  was  conducted  to  evaluate 
data  which  could  be  used  to  improve  the  predictability  of  student  academic 
success  in  the  AFIT  School  of  Engineering  Department  of  Systems  Management. 
In  this  first  chapter  several  background  topics  are  discussed.  The  first 
is  a report  on  the  techniques  used  and  results  achieved  from  previous 
academic  success  prediction  efforts.  Second,  a statement  of  the  problem 
is  presented.  Next,  a discussion  of  the  current  AFIT  eligibility  criteria 
is  provided.  Fourth,  a statement  of  the  hypothesis  is  made.  Finally,  the 
limitations  imposed  and  assumptions  made  are  addressed. 

Because  the  use  of  the  entire  name  for  many  terms  prevalent  in 
this  thesis  would  prove  cumbersome,  a list  of  abbreviations  is  provided  as 
Appendix  A for  the  reader's  convenience. 

Previous  Prediction  Attempts 

It  is  difficult  to  read  a journal  dealing  w?i,h  education  and  not  find 
at  least  one  article  pertaining  to  the  prediction  of  academic  success. 

This  fact  indicates  the  importance  placed  on  the  evaluation  of  existing 
and  proposed  advanced  degree  selection  factors.  The  several  techniques 
and  results  discussed  in  this  section  represent  a cross-section  of  the 
state-of-the-art  as  it  exists  at  the  time  of  this  writing. 

The  most  commonly  used  criterion  of  academic  success  found  in  the 
literature  is  grade  point  average  (GPA).  Grade  point  average  provides  a 
continuous  scale  of  accomplishment  and  can  be  used  with  many  statistical 
techniques.  The  methods  employed  included  bivariate  correlation  analysis, 
multivariate  regression  and  correlation  analysis,  classification  using  the 
Wald  statistic,  and  discriminant  analysis.  The  applications  of  these 
methods  using  the  GPA  criterion  will  now  be  discussed. 


The  use  of  bivariate  correlation  for  the  prediction  of  graduate 
grade  point  average  was  reported  by  Wilson  (1977)  and  by  Lin  and  Humphreys 
(1977).  Wilson's  study,  which  was  performed  for  AFIT,  used  GGPA  as  a 
criterion  and  undergraduate  grade  point  average  (UGPA)  and  Graduate 
Record  Examination  (GRE)  verbal  (V)  and  quantitative  (Q)  scores  as  predic- 
tors. Unexpectedly,  GRE-V  correlated  higher  than  GRE-Q  with  GGPA  for  the 
j Electrical  Engineering  group,  while  GRE-Q  was  the  better  predictor  for 

those  in  Facilities  Management.  Additionally,  while  the  correlation 
coefficient  between  GGPA  and  UGPA  for  Electrical  Engineering  students  was 
' .61  (N  = 30),  it  was  -.25  (N  = 26)  for  Facilities  Management  majors 

I (Wilson,  1977:4).  This  phenomenon  led  Wilson  to  state  that  significant 

i differences  can  occur  "...between  admissions-related  predictors  and  per- 

i formance  measures  in  one  or  more  degree  programs"  (Wilson,  1977:A-1). 

I Thacker  and  Williams  (1974),  in  their  article,  also  warned  that  "...the 

I practice  of  combining  departments  for  predictive  purposes  should  not  be 

! 

employed"  (Thacker  and  Williams,  1974:940),  and  influenced  this  writer  to 

investigate  the  effect  of  systematically  reducing  the  subject  population 

into  progressively  more  homogeneous  subgroups.  The  methodology  and 

results  are  discussed  further  in  Chapters  II  and  III. 

The  research  performed  by  Lin  and  Humphreys  also  used  correlations 

[ between  UGPA  and  GGPA  as  well  as  between  these  and  GRE  and  Law  School 

! 

i Aptitude  Test  scores.  Although  their  research  was  far  more  detailed  than 

I Wilson's  and  indicated  that  their  predictors  tend  to  deteriorate  in 

I utility  over  time  (Lin  and  Humphreys,  1977:256),  the  use  of  bivariate 

correlation  fails  to  consider  the  possibility  of  interaction  between 
various  predictors. 
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A far  more  powerful  statistical  tool  for  the  investigation  of  several 
variables  is  multiple  regression  analysis,  and  this  technique  has  been  the 
most  prevalent  in  the  literature,  especially  when  GGPA  is  used  as  the 
criterion. 

Bean  (1975)  and  Covert  and  Chansky  (1975)  used  multiple  regression 
and  the  most  commonly  used  predictors  (and  advanced  degree  admission  cri- 
teria), UGPA  and  GRE  scores,  in  an  attempt  to  predict  GGPA.  Bean  also 
investigated  Master's  Comprehensive  Examination  scores  and  grades  in 
individual  required  courses  as  criteria.  Their  "Results  showed  different 
predictability  across  the  different  subgroups"  (Bean,  1975:947),  and 
indicated  "...the  need  for  local  validation  of  graduate  admissions 
measures"  (Covert  and  Chansky,  1975:963). 

A research  effort  conducted  by  Federici  and  Schuerger  (1974)  cen- 
tered on  the  use  of  multiple  regression  to  predict  GGPA  and  faculty 
ratings  of  students  from  UGPA,  test  scores,  interview  ratings,  and  bio- 
graphical information.  Additionally,  factor  analyses  were  performed  to 
reduce  the  number  of  independent  variables  from  32  to  11  prior  to  the 
regression.  Their  study  replicated  several  earlier  investigations  in 
that:  (1)  "modest  but  significant  correlations  with  academic  competency 
were  realized,  (2)  the  use  of  an  interview  and  biographical  information 
was  supported  in  selecting  for  interpersonal  skills,  (3)  ratings  of 
recommendations  failed  to  predict  either  graduate  GPA  or  ratings  of  inter- 
personal skills"  (Federici  and  Schueger,  1974:952). 

Soetrisno  (1975)  and  Anderson  (1974)  employed  stepwise  multiple 
regression  to  develop  linear  equations  for  the  prediction  of  GPA  at  the 
Naval  Postgraduate  School  and  at  the  USAF  Academy.  The  wide  variety  of 
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academic  and  biographic  variables  used  showed  a great  deal  of  initiative, 
yet  the  incremental  multiple  correlation  coefficients  achieved  demon- 
strated that  one  or  two  of  the  commonly  used  ability  variables  accounted 
for  most  of  the  variability  in  GPA. 

Hunt  (1977),  in  a primarily  illustrative  paper,  proposed  the  use  of 
the  Wald  statistic  for  the  classification  of  a student  as  predicted  to 
achieve  above  or  below  a specified  GPA  in  junior  and  senior  course  work. 

As  predictors  Hunt  used  Scholastic  Aptitude  Test  scores  and  freshman  and 
sophomore  cumulative  GPA,  and  based  his  decision  rule  on  cost  minimization 
of  a classification  error.  Although  Hunt  suggested  a novel  approach, 
the  classification  utility  and  easy  accessibility  of  discriminant  anal- 
ysis programs  (Nie,  et  al.,  1975:434-467)  make  discriminant  analysis  more 
applicable  to  this  type  of  research  at  present. 

The  only  application  of  discriminant  analysis  to  the  prediction  of 
GPA  encountered  by  this  writer  was  undertaken  by  Sexton  and  Goldman 
(1975).  Their  research  involved  predicting  which  of  five  college  GPA 
categories  a student  would  fall  into  using  high  school  grades  and  number 
of  classes  in  five  groups  (English,  Math,  Science,  History,  and  Foreign 
language)  as  independent  variables.  The  results  achieved  were  that  GPA 
"...was  only  related  to  high  school  grade  averages,"  and  "While  the  pat- 
tern of  high  school  preparation  is  related  to  the  choice  of  a college 
major,  it  is  not  related  to  college  success"  (Sexton  and  Goldman,  1975: 

37). 

Now  that  a discussion  of  the  research  conducted  to  predict  GPA  as  j 

an  academic  success  criterion  has  been  completed,  a different  measure  of  j 

success  will  be  considered.  That  measure  is  whether  or  not  the  degree  I 

i 


candidate  did  complete  the  requirements  for  a degree.  As  was  mentioned 
earlier,  GPA  can  be  easily  evaluated  as  a criterion  with  most  statistical 
techniques,  but  is  it  actually  the  best  measure  of  success?  Can  it  be 
said  that  a degree  candidate  with  excellent  grades  who  does  not  graduate 
because  he  cannot  satisfactorily  complete  his  thesis  work  is  a "success" 
based  on  GGPA,  whereas  the  student  with  the  lowest  GGPA  in  his  class  who 

I 

j receives  his  degree  is  a "nonsuccess?"  In  reality  the  ultimate  success 

* criterion  is  the  dichotomous  "degree/no  degree"  variable,  and  although 

GGPA  prediction  was  evaluated  and  will  be  discussed,  the  primary  purpose 
! of  this  research,  as  indicated  initially,  was  to  predict  degree  receipt. 

I Several  efforts  at  predicting  advanced  degree  completion  are  now  pre- 

i sented. 

I In  an  attempt  to  predict  degree  attainment  among  doctoral  candidates, 

I Nagi  (1975)  used  bivariate  correlation  analysis  with  GRE  and  Miller 

j Analogies  Test  (MAT)  scores  as  predictor  variables.  Both  correlation 

coefficients  failed  to  reach  statistical  significance  at  the  .05  level, 
and  Nagi  concluded  that  "...the  GRE  and  MAT  are  not  substantially  valid 
predictors  of  program  completion"  (Nagi,  1975:472). 

An  interesting  though  simplistic  approach  to  predicting  the  acquisi- 
tion of  advanced  graduate  and  professional  degrees  was  reported  by  Lewis 
(1974).  As  predictors  Lewis  classified  BA  graduates  into  four  groups 
based  on  high  or  low  academic  aptitude  (from  Iowa  Placement  Test  scores) 
and  academic  achievement  (UGPA).  He  further  broke  down  the  groups  based 
on  sex.  The  percentage  of  BA  graduates  in  the  four  ability-achievement 
groups  for  each  sex  completing  advanced  education  were  then  calculated, 
and  the  differences  between  the  percentages  were  tested  for  significance 
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using  the  statistic.  A noteworthy  finding  was  that  the  low 
aptitude/high  achievement  males  were  second  only  to  those  with  high 
aptitude/high  achievement,  and  were  above  the  high  ability/low  achieve- 
ment male  group.  A hypothesis  for  this  phenomenon  is  discussed  later  in 
this  chapter. 

The  final  study  discussed  in  this  section  involves  the  prediction  of 
graduate  degree  receipt  using  the  logistic  quantal  response  model,  and  was 
reported  by  Pickens  (1971).  Using  this  model,  Pickens  estimated  the  func- 
tional relationship  between  the  probability  of  achieving  a Master's  degree 
and  the  two  GRE  scores.  Because  he  attempted  to  predict  a 95  percent 
probability  of  success  from  a population  containing  94  percent  successes, 
Pickens'  results  were  inconclusive.  However,  he  did  state  that,  based  on 
the  low  GRE  scores  attained  by  several  successes  and  the  fact  that  the 
mean  weighted  score  for  failures  was  just  38  points  lower  than  for  suc- 
cesses, "...a  reasonable  policy  would  be  to  cease  requiring  applicants  to 
submit  GRE  aptitude  scores"  (Pickens,  1971:38).  Pickens'  recommendation 
has  not  been  widely  accepted  although  other  research  results  do  tend  to 
indicate  that  the  GRE,  at  least  by  itself,  is  not  a powerful  success 
predictor. 

Numerous  criteria  and  techniques  have  been  utilized  in  past  attempts 
to  predict  academic  success,  and  the  results  reported  were  used  to  stimu- 
late thought  concerning  the  methodology  to  be  used  in  conducting  this 
research.  Having  considered  previous  efforts,  the  remainder  of  this  chap- 
ter will  deal  with  topics  pertaining  directly  to  the  research  reported  on 


in  this  thesis. 


Formal  Problem  Statement 


I 

I 


This  study  was  conducted  to  answer  the  following  question:  What 
data  available  to  the  AFIT  Director  of  Admissions  best  predict  success 
among  candidates  for  Systems  Management  (SM)  and  Operations  Research  (OR)* 

Master's  degrees? 

AFIT  Eligibility  Criteria 

A Graduate  Systems  Management  (GSM)  or  Graduate  Operations  Research 
(GOR)  student,  to  be  eligible  (although  not  necessarily  selected)  for 
AFIT  education,  must  meet  three  requirements: 

(1)  undergraduate  cumulative  GPA  at  least  2.5  on  a 4.0  basis, 

(2)  minimum  score  of  500  on  the  Graduate  Management  Admission 
Test  (GMAT)  total  or  on  both  the  GRE-V  and  GRE-Q, 

(3)  previous  experience  which  indicates  an  ability  to  effec- 
tively le<i"'n  and  use  the  AFIT  education  for  the  good  of 
the  Air  Force. 

However,  tradeoffs  between  these  requirements  are  permitted.  For 
example,  a prospective  student  with  a UGPA  of  less  than  2.5  might  be 
eligible  if  he  had  previously  attained  practical  experience  in  his  pro- 
spective field  of  study,  or  one  with  a low  GRE-V  score  could  overcome  it  ^ 

I 

with  a high  score  on  the  GRE-Q.  Cases  are  judged  on  an  individual  basis  | 

by  the  AFIT  Director  of  Admissions  (Malicki,  1977).  | 

] 

j 

A detailed  description  of  the  USAF  Advanced  Academic  Degree  Manage-  | 

ment  System  is  provided  as  Appendix  B.  i 


*The  GOR  program  was  coded  GSA  (Graduate  Systems  Analysis)  prior  to  1975. 
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r 

Statement  of  the  Hypothesis 

Psychologists  have  known  for  many  years  that  "...a  person  needs  both 

I ability  and  motivation  to  perform  well."  (Porter,  Lawler,  and  Hackman, 

[ 1975:153).  However,  the  selection  criteria  for  most  graduate  programs 

I (including  those  for  AFIT)  have  traditionally  dealt  with  the  measurement 

. of  ability  alone.  The  research  performed  for  this  thesis  investigated 

1 not  or  ’ibility  measures,  but  also  attempted  to  assess  the  predictive 

! 

power  c+  several  "surrogate"  motivational  factors.  These  factors  are 
discussed  in  detail  in  Chapter  II. 

^ For  the  above  reason,  the  following  hypothesis  is  made:  predictors 

I exist  which  can  be  used  to  aid  in  the  selection  of  students  to  attend 

I AFIT  GSM  or  GOR  Master's  degree  programs,  and  measures  of  both  ability 

I and  motivation  are  predictors  of  success. 

Scope  and  Limitations  j 

Due  to  the  vast  amount  of  data  available  and  the  time  constraint  | 

I 

imposed,  only  predictors  for  the  selection  of  students  for  the  AFIT  j 

Department  of  Systems  Management  were  examined.  However,  certain  predic-  j 

tors  (especially  motivational)  could,  with  further  research,  prove  ap- 
plicable for  the  selection  of  students  for  other  departments  as  well. 

Additionally,  no  data  were  collected  on  GSM  or  GOR  students  who  were 
scheduled  to  graduate  prior  to  1973  to  minimize  wartime  distortion.  > 

Chapter  II  provides  a thorough  description  of  the  subject  popula- 
tion. 
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Assumptions 

It  is  assumed  that  the  ultimate  criterion  of  success  in  an  advanced 
academic  program  is  degree  receipt,  and  that  cumulative  GGPA  is  a secon- 
dary measurement. 

Summary  and  Overview 

This  first  chapter  has  discussed  background  information  considered 
pertinent  to  the  research  performed,  and  was  intended  to  prepare  the 
reader  for  the  report  to  follow.  Six  topics  were  discussed; 

(1)  previous  prediction  attempts, 

(2)  formal  problem  statement, 

(3)  AFIT  eligibility  criteria, 

(4)  statement  of  the  hypothesis, 

(5)  scope  and  limitations,  and 

(6)  assumptions. 

Three  more  chapters  are  included.  In  Chapter  II  the  overall  research 
methodology  is  discussed.  Chapter  III  presents  the  results  of  the  analysis. 
Finally,  the  conclusion  and  recommendations  are  made  in  Chapter  IV. 


II.  METHODOLOGY 


In  this  chapter  the  methodology  used  to  conduct  the  research  is  dis- 
cussed in  four  parts.  These  parts  consist  of  the  composition  of  the  popu- 
lation examined,  the  criterion  variables,  the  predictor  variables,  and  the 
specific  analytical  techniques  utilized. 

Population 

The  population  examined  included  all  male  USAF  officers  who  began  the 
GSM  or  GOR  program  in  August  1971*  or  later  and  who  either  received  a 
degree  or  were  released  from  the  program  and  did  not  receive  a degree  prior 
to  April  1977  (the  data  collection  month).  Only  three  subjects,  all  civil- 
ian, were  rejected.  This  resulted  in  a total  population  of  223  students 
in  seven  GSM  (N  = 138)  and  five  GOR  (N  = 85)  classes  expected  to  graduate 
in  1973  through  1976.  Part  of  the  total  population  also  included  four 
students  scheduled  to  graduate  after  April  1977  but  who  chose  Self- 
Initiated  Elimination  (SIE)  prior  to  April  and  thus  became  part  of  the  data 
group.  The  population  contains  23  persons  (13  GSM  and  10  GOR)  who  failed 
to  obtain  a degree  for  reasons  which  are  provided  in  the  next  section. 

The  data  selected  for  evaluation  were  extracted  from  individual  student 
records  which  are  maintained  at  the  AFIT  Directorate  of  Admissions.  These 
records  contain  the  information  available  to  AFIT  for  the  determination  of 
eligibility,  a complete  transcript  of  the  student's  AFIT  grades,  and  basic 
biographical  facts. 

*The  GOR  program  was  21  months  in  length  at  this  time,  and  the  GSM  was  18 
months  long.  i 
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Criterion  Variables 


Two  criteria  of  academic  success  were  selected  for  the  analysis. 

The  secondary  measure  for  the  purposes  of  this  thesis,  GGPA,  is  discussed 
first,  then  degree  receipt/nonreceipt,  the  primary  criterion,  is  considered. 

GGPA.  This  is  the  total  cumulative  AFIT  grade  point  average  achieved 
for  all  graded  course  work  (including  thesis)  until  graduation  or  release 
from  the  degree  program  on  a 4.0  basis  (4.0  = all  A's).  The  seven  SIE's 
(3  GSM,  4 GOR)  were  deleted  from  consideration  using  this  criterion  due  to 
the  questionable  meaning  of  their  GGPA’s,  but  were  considered  as  part  of 
the  "no  degree"  population.*  For  the  remaining  216  cases,  the  mean  GGPA 
was  3.44  with  a standard  deviation  of  .44. 

It  was  originally  planned  to  investigate  GGPA  without  thesis  grade  as 
a criterion  as  well,  but,  because  the  bivariate  correlation  coefficient 
between  GGPA  and  GGPA  without  thesis  was  .99plus,  this  effort  would  have 
proven  redundant. 

Degree  Receipt/Nonreceipt.  Prediction  of  this  dichotomous  criterion 
variable  was  the  primary  purpose  of  this  research.  Degree  receipt  is 
defined  as  meeting  the  AFIT  requirements  for  graduation  within  five  years 
after  the  scheduled  graduation  of  the  class  section  (Air  Force  Institute  of 
Technology,  1976:30)  or  by  the  data  collection  month  (April  1977),  which- 
ever occurs  first.  Degree  nonreceipt  is  considered  to  be  noncompletion 
of  the  requirements  in  the  same  time  frame.  There  were  varied  reasons  for 
noncompletion  of  the  degree  requirements.  For  the  population  investigated 

*A1 though  the  identification  of  factors  which  might  indicate  which  SIE 
candidates  would  voluntarily  join  the  "no  degree"  population  is  of  vital 
interest,  it  is  doubtful  that  most  of  their  GGPA's  would  indicate  perform- 
ance had  they  not  reached  an  SIE  decision. 
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these  reasons  included:  (1)  academic  deficiency,  (2)  incomplete  or  unac- 
ceptable thesis  work,  (3)  lack  of  academic  integrity  (one  student),  and 
(4)  SIE.  It  is  interesting  to  note  that,  except  for  two  students  who 
accomplished  their  degree  requirements  shortly  after  the  scheduled  class 
graduation,  none  of  the  candidates  who  failed  to  receive  a degree  on  time 
completed  the  degree  requirements  later.  However,  two  degree  nonrecipients 
are  presently  known  to  be  working  toward  requirement  completion. 

Predictor  Variables 

The  selected  predictors  of  success  based  on  the  above  criteria  con- 
sisted of  14  independent  variables.  These  variables  were  chosen  so  as  to 
provide  a varied  base  of  academic  and  biographic  factors  and  yet  be 
readily  available  to  AFIT  Directorate  of  Admissions  personnel.  Each  of 
the  predictor  variables  is  discussed  in  detail  below. 

Undergraduate  GPA.  UGPA  is  the  most  commonly  used  success  predictor 
Tor  graduate  school  admission.  It  provides  a measure  of  the  past  academic 
achievement  (a  function  of  both  ability  and  motivation  as  was  discussed  in 
Chapter  I)  of  the  prospective  student.  All  UGPA's  were  computed  on  a 4.0 
maximum  basis.  The  total  population  (N  = 223)  has  a mean  (x)  UGPA  of 
2.96  with  a standard  deviation  (s)  of  .34. 

Age  at  AFIT  Entry.  For  age  of  the  student  in  years  at  the  start  of 
his  AFIT  education,  the  population  x = 30.31  and  s = 3.63. 

Time  Since  Undergraduate  Degree  Receipt.  This  is  the  number  of  years 
since  receipt  of  the  Bachelor's  degree  and  was  selected  to  investigate  the 
possible  influence  of  academic  "staleness."  It  was  expected  that  this 
variable  would  be  very  highly  correlated  with  age  and  the  bivariate 
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correlation  coefficient  between  the  two  (.740)  was  significant  although 
not  as  high  as  anticipated.  Total  population  x = 7.04,  s = 3.21. 

National  Military  Academy.  This  dichotomous  predictor  represents 
whether  or  not  a student's  undergraduate  degree  was  granted  by  the  U.S. 

Air  Force  Academy,  U.S.  Naval  Academy,  or  U.S.  Military  Academy.  It  was 
selected  to  investigate  the  relationship  between  undergraduate  education 
in  a rigid  environment  and  graduate  school  performance.  Of  the  total 
population,  38.6  percent  attended  a military  academy. 

Undergraduate  Degree  not  in  Engineering,  Math,  or  a Physical  Science. 
Because  both  the  GSM  and  GOR  curricula  require  the  use  of  analytic  geom- 
etry, matrix  manipulation,  differentiation,  and  integration,  this  vari- 
able was  selected  to  measure  quantitative  background.  The  number  of 
students  not  possessing  one  of  these  degrees  is  21.1  percent  of  the  total. 

Marital  Status.  This  variable  is  a dichotomy  only  and  is  defined  as 
married  or  single  at  the  time  of  AFIT  entry.  No  attempt  was  made  to 
investigate  further  breakouts  such  as  single  but  divorced  or  married  but 
separated.  The  single  students  constituted  14.4  percent  of  the  total 
population. 

Volunteer  for  AFIT.  Unlike  students  at  civilian  universities,  AFIT 
students  need  not  necessarily  apply  for  admission.  Prospective  AFIT 
Master's  degree  candidates  can,  of  course,  apply.  The  application 
(volunteer)  process  involves  the  actual  preparation  of  a formal  request 
for  advanced  education  and  is  accompanied  by  the  usual  documentation 
necessary  for  acceptance  into  most  civilian  Master's  degree  programs 
(college  transcript,  biographical  data,  etc.).  Additionally,  the  prospec- 
tive student  must  complete  the  GRE  or  GMAT  before  his  application  is 
considered. 


14 


1 

I 

As  an  alternative,  the  student  may  be  selected  for  AFIT  education 
without  applying.  These  students  are  termed  "centrally  identified"  (non- 
volunteer). A description  of  this  selection  process  is  provided  in 
Appendix  B.  The  nonvolunteers  did  not  actively  seek  out  the  opportunity 
to  achieve  an  advanced  degree  as  did  the  volunteers.  For  this  reason 
volunteer  status  is  used  as  a surrogate  measure  of  the  student's  motiva- 
tion toward  the  attainment  of  the  degree.  The  population  includes  46.2 
percent  volunteers. 

Aeronautical  Rating.  This  variable,  like  the  preceeding  four,  is 
dichotomous.  No  distinction  is  made  between  types  of  rating  (pilot  or 
navigator)  for  this  study.  The  total  population  contains  60.1  percent 
USAF  rated  officers. 

GRE  Scores.  The  GRE,  like  UGPA,  is  a widely  used  instrument  for 
determining  the  acceptability  of  graduate  education  applicants,  although 
AFIT  allows  the  student  to  complete  the  GMAT  as  an  alternative  (Air  Force 
Institute  of  Technology,  1976:6).  Three  different  GRE  scores  were 
gathered.  The  GRE  verbal  and  quantitative  scores  were  recorded  on  a per- 
centile basis  to  allow  combination  and  comparison  with  the  GMAT  scores. 

The  percentile  standing  was  selected  because  GMAT  and  GRE  scores  are 
scaled  differently.  Although  percentile  ranks  for  a given  score  depend  on 
when  the  test  was  taken,  "Total  scaled  scores  are  directly  comparable 
across  years."  (Educational  Testing  Service,  1975:13).  However,  the 
scaled  scores  were  converted  to  percentiles  using  a single  conversion 
chart  (candidates  tested  from  October  1971  through  September  1974)  thus 
making  the  percentile  ranks  obtained  also  directly  comparable. 

A GRE  total  (T)  score  was  calculated  by  adding  the  GRE-V  and  GRE-Q 
scores.  This  treatment  was  necessary  because  there  is  no  total  score 
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provided  for  the  GRE,  yet  an  overall  single  figure  was  desired  for  the 
analysis.  Additionally,  summing  the  two  scores  provides  a means  of  in- 
vestigating the  tradeoff  policy  (discussed  in  Chapter  I under  AFIT 
Eligibility  Criteria)  used  by  AFIT  Admissions.  To  illustrate,  a GRE-V  of 
450  and  GRE-Q  of  550  yields  a total  of  1000,  the  same  total  as  would  be 
obtained  if  500  were  scored  on  both  parts. 

The  means  and  standard  deviations  for  all  those  taking  the  GRE 
(N  = 140)  are  provided  in  Table  I. 


TABLE  I 

GRE  Means  and  Standard  Deviations 


X 

s 

GRE-V  (percentile) 

63.81 

20.55 

GRE-Q  (percentile) 

85.56 

12.82 

GRE-T  (points) 

1261.21 

113.88 

GMAT  Scores.  Entitled  the  Admission  Test  for  Graduate  Study  in  Busi- 
ness (ATGSB)  prior  to  1976,  the  GMAT  is  another  frequently  used  instrument 
for  graduate  school  student  selection.  Because  the  GMAT  "...scores  are 
related  to  the  same  reference  group  rather  than  to  each  other,  it  makes 
no  difference  when  or  where  you  are  tested."  (Educational  Testing  Service, 
1976:13).  Therefore,  the  GMAT-V  and  GMAT-Q  scores  were  converted  to  per- 
centiles in  a manner  identical  to  that  used  for  the  GRE  scores  and  employ- 
ing a conversion  table  based  on  1971-1974  test  results.  Because  a GMAT 
total  score  is  also  provided  this  value  was  recorded  directly. 

Table  II  contains  the  means  and  standard  deviations  for  those  students 
who  took  the  GMAT  (N  = 102). 
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TABLE  II 


GMAT  Means  and  Standard  Deviations 


X 

s 

GMAT-V  (percentile) 

72.40 

20.11 

GMAT-Q  (percentile) 

75.53 

18.65 

GMAT-T  (points) 

570.88 

73.60 

Having  discussed  the  population  composition  and  variables  selected 
for  this  study,  a presentation  of  the  techniques  used  in  the  analysis  of 
the  data  collected  is  now  given. 

Specific  Analytical  Techniques 

Predictor  evaluation  using  the  two  selected  criteria,  GGPA  and  degree 
receipt/nonreceipt,  was  conducted  by  applying  three  multivariate  data 
analysis  techniques.  GGPA,  which  provides  a continuum  of  performance 
measure  between  0.00  and  4.00,  was  investigated  using  multiple  regression 
analysis.  Evaluation  of  predictors  for  the  dichotomous  degree  receipt/ 
nonreceipt  criterion  was  done  using  a combination  of  the  Automatic  Inter- 
action Detection  (AID)  algorithm  and  discriminant  analysis,  two  techniques 
well  suited  for  the  analysis  of  dichotomies. 

The  remainder  of  this  chapter  considers  the  specific  analytical 
techniques  used  in  the  research.  First,  GGPA  prediction  is  discussed  and 
includes  a description  of  the  statistical  technique  employed  as  well  as  a 
review  of  the  way  that  technique  was  applied.  The  section  concludes  with 
a synopsis  of  the  degree  receipt/nonreceipt  criterion  analysis  and  is 
organized  similarly  to  the  GGPA  discussion. 
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G6PA  Prediction.  As  was  mentioned  in  Chapter  I,  regression  analysis 
has  been  widely  used  in  previous  attempts  to  predict  GGPA,  but  the  efforts 
have  not  been  highly  successful.  Further,  past  researchers  (Wilson,  1977, 


1 

I 

I 
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and  Thacker  and  Williams,  1974)  warned  against  the  practice  of  combining 
nonhomogeneous  groups  for  predictive  purposes.  For  this  reason  the  intent 
of  this  portion  of  the  study  is  to  use  multiple  regression  analysis  to 
investigate  the  effect  of  progressively  increasing  the  homogeneity  of  sub- 
ject groups  on  GGPA  predictive  aoility. 

Bivariate  regression  analysis  is  a technique  used  for  examining  the 
connection  between  two  variables  by  mathematically  fitting  a smooth  trend 
line  to  the  relationship  between  the  variables.  "Hence,  the  idea  behind 
regression  is  that  all  observations  of  a variable  are  best  explained  by 
this  fitted  line,  which  is  simply  the  calculated  best  fit  of  a trend  line 
to  the  relationship  between  two  sets  of  measurements. . (Heenan  and 
Addleman,  1976:46).  Multiple  regression  extends  this  idea  to  the  case  of 
one  criterion  and  multiple  predictor  variables.  A detailed  treatment  of 
multiple  regression  analysis  is  provided  in  a widely  used  text  by  Draper 
and  Smith  (1966). 

For  the  research  the  stepwise  multiple  regression  analysis  subprogram 
contained  in  the  Statistical  Package  for  the  Social  Sciences  (SPSS)  was 
used  (Nie,  et  al.,  1975:320-367).  In  stepwise  solution  the  independent 
variables  are  entered  into  the  regression  equation  one  by  one  and  only  if 
they  meet  pre-established  statistical  criteria,  or  are  deleted  if  they  no 
longer  meet  similar  or  other  criteria  (Nie,  et  al.,  1975:345).  An  inclu- 
sion F ratio  (Nie,  et  al.,  1975:346)  of  3.0  was  selected  so  as  to  be 
slightly  below  3.92,  that  value  which  provides  a .05  significance  level 
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for  a fairly  large  sample  and  one  independent  variable  (Nie,  et  al., 
1975:339,  and  Freund,  1971:439). 

The  analysis  involved  the  performance  of  five  multiple  regression 
computer  runs.  The  first  four  runs  considered  three  sets  of  progressively 
more  homogeneous  student  groups.  The  fifth  was  conducted  primarily  to 
investigate  the  substitutability  of  one  test  for  the  other  by  examining  a 
group  who  took  both.  Each  of  the  five  computer  runs  is  described  below. 

(1)  Total  Population.  This  group  (N  = 216)  includes  all 
those  students  selected  for  the  study  less  the  seven 
SIE's.  The  6RE  and  GMAT  scores  were  deleted  from 
consideration  as  predictors  to  avoid  the  necessity  of 
assigning  a score  of  zero  to  a student  who  did  not 
take  a given  test. 

(2)  All  Students  Who  Took  at  Least  One  Entry  Test.  Selec- 
tion of  this  particular  group  of  189  was  performed  to 
allow  inclusion  of  test  scores  as  predictors.  The 
verbal  and  quantitative  GRE  or  GMAT  percentiles  were 
used  directly  and  coded  TEST-V  and  TEST-Q  if  only  one 
test  was  taken.  If  both  tests  were  taken,  the  scores 
on  each  were  averaged  on  the  assumption  that  the  tests 
are  interchangeable  as  predictors  (as  AFIT  Admissions 
practices).  A total  TEST  score  was  calculated  by 
adding  the  TEST-V  and  TEST-Q  scores. 

(3)  All  GSM  Students  Mho  Took  a Test.  This  further  break- 
out of  the  above  population  was  performed  to  remove 
the  effect  of  mixing  students  from  different  courses 
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of  study  and  resulted  in  135  students.  TEST  scores 
were  used  as  predictors  and  were  determined  as  described 
in  the  proceeding  paragraph. 

(4)  All  GOR  Students  Who  Took  a Test.  This  group  was 
selected  for  the  identical  reason  as  was  the  GSM 
sample  described  immediately  before,  and  contains  81 

> 

I persons . 

I 

^ (5)  All  Students  Who  Took  Both  Tests.  As  was  mentioned 

earlier,  this  group  was  selected  to  investigate  the 

I correlation  between  GMAT  and  GRE  scores,  and  if  they 

I are  not  good  substitutes,  to  find  out  which  of  the 

j two  best  predicts  GGPA.  Surprisingly,  50  of  the  216 

{ total  GGPA  prediction  population  (23%)  took  both  the 

j GRE  and  GMAT. 

I The  analytical  techniques  used  to  examine  GGPA  prediction  have  been 

! 

discussed,  and  the  results  are  presented  in  Chapter  III.  The  methods  used 
in  predicting  the  primary  academic  success  criterion,  degree  receipt  or 
nonreceipt,  are  now  examined. 

Degree  Receipt/Nonreceipt  Prediction.  For  reasons  given  earlier  in 
this  chapter  during  the  discussion  of  the  criterion  variables,  this  analy- 
sis was  begun  using  the  total  collected  sample  of  223  students  of  which 
23  were  degree  nonrecipients.  Two  distinct  but  interrelated  analyses 
were  performed.  First,  the  Automatic  Interaction  Detection  (AID)  algo- 
rithm was  used  to  look  at  the  predictor  values  which  were  most  character- 
istic of  each  of  the  two  groups  (degree  or  no  degree)  and  to  provide 
clues  for  the  creation  of  new  predictor  variables.  Then,  discriminant 
analysis  was  applied  to  verify  and  further  evaluate  the  AID  results. 
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The  AID  algorithm  "...is  a heuristic  approach  to  searching  the  raw 
data  for  structure  and  is  purely  a mechanization  of  the  procedure  a 
researcher  might  go  through  manually  in  hypothesizing  a model."  (Gooch, 
1972:66).  The  computer  program  sequentially  divides  the  set  of  data  into 
subsets  based  on  that  split  which  causes  the  greatest  reduction  in  the 
unexplained  variability,  and  uses  one-way  analysis  of  variance  over  every 
possible  predictor  split.  The  computer  output  provides  a series  of 
splits  and  a set  of  subgroups  best  explaining  the  criterion  variability 
(Gooch,  1972:63).  A useful  feature  of  AID  is  that  a graphical  display 
of  the  splitting  process  is  provided  in  the  form  of  an  AID-Tree  which 
"...allows  visualization  of  the  inherent  structure  in  the  data"  (Gooch, 
1972:63,66).  A detailed  description  of  the  AID  algorithm  is  provided  by 
the  developers,  Sonquist  and  Morgan  (1970). 

For  the  AID  computer  run  the  maximum  number  of  final  groups  allowed 
was  set  at  15,  and  five  was  selected  as  the  smallest  number  of  cases  per 
subgroup.  Eleven  variables  were  chosen  for  inclusion  in  the  analysis. 

The  criterion  used  was  degree  receipt/nonreceipt.  Six  dichotomous  pre- 
dictor variables  were  investigated: 

(1)  course  of  study  (GSM  or  GOR), 

(2)  did/did  not  attend  a national  military  academy, 

(3)  undergraduate  degree  was/was  not  in  engineering, 
mathematics,  or  a physical  science, 

(4)  married/single, 

(5)  volunteer/nonvolunteer  for  AFIT,  and 

(6)  aeronautically  rated/nonrated. 

Additionally,  four  continuous  variables  were  used,  and  each  was  sub- 
divided into  five  intervals  as  indicated  in  Table  III.  The  subdivision 


of  UGPA  was  accomplished  so  as  to  provide  one  interval  for  students  who 
did  not  achieve  an  undergraduate  2.50  (AFIT  eligibility  criterion)  and 
four  other  intervals  representing  various  levels  of  achievement.  The 
age  variable  groups  include  subjects  ranging  from  "young"  to  "old"  rela- 
tive to  most  AFIT  GSM  and  GOR  students  (62.8%  of  the  sample  were  between 
27  and  32  when  they  entered).  The  test  score  intervals  were  selected  to 
provide  one  for  students  not  taking  the  test,  one  for  those  who  took  it 
but  did  not  achieve  the  AFIT  eligibility  criterion  score,  one  for  students 
achieving  very  high  scores,  and  two  representing  moderately  high  scores. 


Interval 


TABLE  III 

AID  Continuous  Predictor  Variable  Intervals 


Variable 


UGPA 

Age 

Entering  AFIT 

GRE-Total 

GMAT- Total 

0-2.50 

0-26 

0(no  test) 

0(no  test) 

2.51-2.75 

27-28 

1-1000 

1-500 

2.76-2.95 

29-30 

1001-1200 

501-550 

2.96-3.15 

31-32 

1201-1350 

551-625 

3.16-4.00 

33+ 

1351  + 

626+ 

After  interpretation  of  the  AID  results  was  completed,  investigation 
through  the  use  of  discriminant  analysis  was  begun,  and  included  a study 
of  two  different  samples  for  reasons  which  are  discussed  later  in  this 
section. 

Discriminant  analysis  is  a statistical  technqiue  which 

"...tries  to  define  a functional  relationship  for 
assigning  individuals. . .to  various  groups.  In 
other  words,  it  attempts  to  classify  an 
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observation  into  one  of  several  a priori 
groupings  dependent  upon  the  observation's 
individual  characteristics."  (Heenan  and 
Addleman,  1976:46). 

This  characteristic  makes  it  ideally  suited  for  the  dichotomous  criterion 
and  type  of  sample  investigated  for  this  thesis.  A thorough  treatise 
covering  discriminant  analysis  can  be  found  in  the  description  of  SPSS 
(Nie,  et  al .,  1975:434-367). 

The  study  consisted,  first,  of  an  evaluation  of  the  total  population 
of  223.  Stepwise  discriminant  analysis  using  the  maximum  Mahalonobis 
distance  criterion  was  employed  (Nie,  et  al.,  1975:447).  Additionally, 
the  F ratio  for  entry  into  the  analysis  was  set  at  3.0  (Nie,  et  al.,  1975; 
453-454),  and  a Bayesian  adjustment  was  made  to  the  group  membership 
probabilities  by  inserting  the  prior  knowledge  of  the  population  distribu- 
tion of  cases  based  on  group  size  (Nie,  et  al.,  1975:455-456).  A run  was 
also  made  with  all  the  above  criteria  except  that  the  probability  of  mem- 
bership in  either  group  was  made  equal. 

The  predictor  variables  used  in  the  analysis  were  those  determined 
from  the  AID  investigation  to  be  the  most  important,  and  included  several 
newly  created  variables.  The  actual  predictors  employed  are  discussed  in 
Chapter  III  when  the  results  of  the*  AID  analysis  are  presented. 

The  discriminant  analysis  was  taken  one  step  beyond  the  examination 
of  the  total  population  due  to  a situation  which  cannot  be  ignored. 

Because  the  total  population  was  made  up  of  89.7  percent  "successes,"  it 
is  not  clear  whether  the  discriminant  weights  based  on  the  real  data  lead 
to  high  correct  classification  rates  because  of  great  inherent  accuracy, 
or  due  to  the  possibility  that  they  would  classify  almost  all  subjects 
as  "successes." 
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In  an  effort  to  circumvent  this  possibility,  one  final  discriminant 
analysis  run  was  performed.  All  criteria  (F  ratio,  etc.)  were  maintained 


constant.  However,  a new  data  group  was  created  by  using  all  23  degree 
nonreceipients  and  randomly  selecting  an  equal  number  from  among  those  who 
did  receive  a degree.  This  new  sample  of  46  students  was  then  subjected 
to  computer  evaluation,  and  the  results  obtained  were  compared  to  those 
for  the  entire  student  population.  The  results  are  presented  in  Chapter 
III. 

Summary 

This  chapter  has  provided  the  reader  with  a description  of  the 
methodology  used  in  conducting  the  research.  Specifically,  four  topics 
were  discussed: 

(1)  the  population  examined, 

(2)  the  criterion  variables  employed, 

(3)  the  predictor  variables  evaluated,  and 

(4)  the  specific  analytic  techniques  used  to  predict 
GGPA  and  degree  receipt/nonreceipt. 

In  Chapter  III  the  results  obtained  are  presented. 
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III.  RESULTS 


This  chapter  provides  the  results  and  interpretations  of  the  data 
analyses.  The  presentation  is  in  three  parts.  First,  GGPA  prediction 
using  multivariate  regression  analysis  is  discussed.  Second,  the  use  of 
AID  for  predicting  degree  receipt  or  nonreceipt  is  examined.  Finally,  the 
results  of  the  degree  receipt/nonreceipt  investigation  using  discrimin- 
ant analysis  are  provided. 

GGPA  Prediction  With  Multivariate  Regression  Analysis 

As  was  stated  in  Chapter  II,  one  purpose  of  this  portion  of  the 
analysis  is  to  investigate  the  effect  of  increasing  the  homogeneity  of  the 
population  on  the  predictive  power  attainable.  Three  levels  of  groups 
were  investigated,  and  are  summarized  in  Figure  1. 


Level  I 

Group  1.  All  students  in  the  sample  population 
minus  SIE's  (N  = 216)  and  referred  to 
as  "ALL" 


I 

increasing 
homogenei ty 

Group  1.  All  GSM  students  (less  SIE's)  who  took 
the  GRE  and/or  the  GMAT  (N  = 114), 
addressed  as  "ALL  GSM  TESTED" 

Group  2.  All  GOR  students  (less  SIE's)  who  took 
the  GRE  and/or  the  GMAT  (N  = 75), 
called  "ALL  GOR  TESTED" 


Level  II 

Group  1.  All  students  (less  SIE's)  who  took  the 
GRE  and/or  the  GMAT  (N  = 189),  called 
"ALL  TESTED" 

Level  III 


Figure  1.  GGPA  Prediction  Homogeneity  Levels 
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For  the  total  group,  eight  predictors  were  utilized  for  the  regres- 
sion: (1)  UGPA,  (2)  age,  (3)  time  since  receipt  of  undergraduate  degree, 
(4)  attended  a military  or  civilian  undergraduate  institution,  (5)  under- 


graduate degree  is  or  is  not  in  engineering,  mathematics,  or  a physical 
science,  (6)  single  or  married,  (7)  AFIT  volunteer  or  nonvolunteer,  and 
(8)  aeronautical ly  rated  or  nonrated.  The  remaining  three  regressions 
I were  run  using  the  previous  eight  predictors  and  three  others:  (9)  GRE 

i and/or  GMAT  verbal  percentile  score  (TEST-V),  (10)  GRE  and/or  GMAT  quan- 

titative percentile  score  (TEST-Q),  and  (11)  the  sum  of  the  TEST-V  and 
! TEST-Q  scores  (TEST-T). 

The  results  of  the  computer  runs  are  presented  in  Table  IV,  and  the 

bivariate  correlation  matrices  are  provided  in  Appendix  C.  The  "Level" 

and  "Group"  columns  in  the  table  are  as  defined  in  Figure  1.  Each  of 

the  remaining  eight  column  meanings  are  described  below. 

i Predictors.  These  are  the  variables  present  in  the  regression  equa- 

I 

tion  (Nie,  et  al.,  1975:328)  at  computer  run  completion.  Brief  descrip- 
tions of  the  coding  and  meaning  of  three  of  the  variables  are  essential 
to  the  interpretation  of  Table  IV,  and  are  provided  in  the  order  in  which 
they  appear  in  the  table. 

(1)  AFITVOL.  Volunteers  for  AFIT  = 1,  nonvolunteers  = 0 

(2)  (CONSTANT).  A criterion  value  to  which  modifications  are 

I 

made  based  on  the  value  of  the  predictors  in  the  equation 
to  obtain  the  predicted  GGPA  (Nie,  et  al.,  1975:328) 

(3)  U-DEGREE.  Undergraduate  degree  in  engineering,  mathematics,  • 

or  a physical  science  = 0,  otherwise  = 1 j 

B (Beta  Weight).  The  values  of  B are  the  standardized  regression 
coefficients  (Nie,  et  al.,  1975:325)  at  run  termination.  The  standardized  j 
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(N  = 75)  (CONSTANT)  3.422  2285.39 


values  are  used  to  enable  the  reader  to  determine  the  relative  contribu- 


tion of  each  variable  to  GGPA  prediction  keeping  in  mind  that  a B with 
a minus  value  indicates  a negative  relationship.  The  CONSTANT  value  is 
listed  in  this  column  for  convenience. 

F and  Significance.  The  F ratio  enables  the  determination  of  the 
significance  level  at  which  the  regression  coefficient  of  a given  inde- 
pendent variable  could  be  equal  to  zero  (Nie,  et  al . , 1975:336),  and 
pertains  to  the  value  of  B at  run  termination.  No  significance  level 
of  greater  than  .05  was  accepted. 

Multiple  R and  R^.  The  value  of  R is  the  multiple  correlation 
coefficient  as  each  variable  is  added  to  the  equation  (Nie,  et  al.,  1975: 
331),  The  final  R given  is  that  obtained  with  all  the  variable  present. 
The  R^  value  is  also  provided  because  it  enables  straightforward  inter- 
pretation of  the  percent  of  variation  in  the  criterion  explained  by  the 
predictors  (Nie,  etal.,  1975:331). 

Overall  F and  Significance.  These  values  are  interpreted  the  same  as 
the  F and  significance  previously  discussed  except  that  they  do  "...not 
indicate  which  specific  B.  values  are  nonzero,"  (Nie,  et  al.,  1975:336) 
and  pertain  to  the  overall  values  as  each  predictor  enters  the  equation. 

From  Table  IV  it  can  be  seen  that  the  trend  in  the  values  of  multiple 
R and  R^  is  toward  progressively  better  predictive  power  as  sample 
homogeneity  is  increased.  It  could  be  argued  that  the  increases  in  R are 
small,  and  this  is  conceded.  However,  it  must  be  remembered  that  the  GSM 
and  GOR  curricula  are  relatively  similar,  and  it  is  suspected  that  much 
greater  differences  would  be  apparent  if  students  in,  for  example,  GSM  and 
Electrical  Engineering  courses  were  combined  and  then  separated  for  predic- 
tive purposes, 
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Several  other  observations  from  the  table  are  worth  consideration. 
First,  UGPA  is  the  most  often  included  predictor  of  GGPA.  Second,  U-DEGREE, 
when  present,  is  negatively  correlated  with  GGPA.  Finally,  the  multiple 
correlation  coefficients  obtained  using  a .05  significance  reauirement  are 
modest,  and  indicate  the  difficulty  of  GGPA  prediction  and  desirability  of 
employing  a more  predictable  success  criterion. 

It  was  mentioned  earlier  that  a comparison  of  the  GRE  and  GMAT  as 
predictors  of  GGPA  was  also  undertaken.  The  final  portion  of  this  section 
discusses  the  evaluation.  Because  only  50  students  (13  GOR,  37  GSM)  took 
both  the  GRE  and  GMAT,  and  because  AFIT  Admissions  allows  the  submission 
of  either  test,  the  students  from  both  disciplines  were  combined  for 
this  investigation. 

Table  V provides  the  bivariate  correlation  coefficients  between  the 
GRE  and  GMAT-V,  GMAT-Q,  and  GMAT-T  scores.  It  is  apparent  that  the  tests 
do  not  measure  identical  abilities,  nor  are  they  claimed  to  (Educational 
Testing  Service,  1975:9,  and  1976:4). 


TABLE  V 

GRE  and  GMAT  Bivariate  Correlations 


GRE-V 

GRE-Q 

GRE-T 

GMAT-V 

.783 

GMAT-Q 

.593 

GMAT-T 

.826 

In  an  effort  to  determine  the  best  test  score  for  GGPA  prediction,  a 
final  regression  was  run  using  13  independent  variables:  UGPA,  Age, 


29 


1 
1 

military  academy  (yes/no),  undergraduate  degree  in  engineering,  mathematics, 
or  a physical  science  (yes/no),  marital  status,  volunteer  status,  aero- 
nautically  rated  or  nonrated,  and  the  three  GRE  and  GMAT  scores.  The 
results  are  given  in  Table  VI,  and  the  correlation  matrix  is  in  Appendix  C. 

TABLE  VI 

j Test  Score  Regression  Results 


Predictor 

B 

F 

Signi fi - 
cance 

R 

RM%) 

.437 

11.32 

.002 

.437 

19.1 

2.383 

58.52 

For  this  group  the  best  GGPA  predictor  is  GMAT-Q.  This  result  is  not 
surprising  in  that  both  the  GOR  and  GSM  curricula  are  quantitative  in  nature 
and  managerially  oriented.  It  is  surprising  that  GMAT-Q  was  the  only  vari- 
able  to  enter  the  equation  using  a .05  significance  requirement,  and  that 
19.1  percent  of  the  variation  is  GGPA  is  explained  by  GMAT-Q  alone. 

GGPA  prediction  using  multivariate  regression  analysis  has  been  dis- 
cussed. Now  graduate  school  success  using  the  degree  receipt/nonreceipt 
criterion  is  considered,  and  begins  with  the  results  of  the  Automatic 
Interaction  Detection  (AID)  analysis. 

Degree  Receipt/Nonreceipt  Prediction  with  AID 

It  was  stated  in  Chapter  II  that  AID  was  not  used  as  an  end  in  itself 
but  as  a means  of  evaluating  the  structure  of  the  data  and  creating  new 
predictor  variables  for  the  discriminant  analysis.  This  approach  was  used 
because,  "While  AID  can  identify  potential  relationships,  its  use  is  ques- 
tionable on  the  matter  of  statistical  significance."  (Heenan  and  Addleman, 
1976:51). 
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The  analysis  was  conducted  using  ten  predictors: 

(1)  course, 

(2)  UGPA, 

(3)  age  entering  AFIT, 

(4)  military  academy  (yes/no), 

(5)  undergraduate  degree  in  engineering, 
mathematics,  or  a physical  science  (yes/no), 

(6)  marital  status, 

(7)  AFIT  volunteer  status, 

(8)  aeronautical ly  rated  or  nonrated, 

(9)  GRE  total  score,  and 

(10)  GMAT  total  score. 

The  AID  summary  tree  for  the  first  five  splits*  is  presented  in 
Figure  2,  and  indicates  several  highly  interesting  findings.  These 
findings  are  discussed  below. 

(1)  The  first  split  (that  which  causes  the  greatest 
reduction  in  the  unexplained  variability)  is  on 
marital  status.  Ten  single  students  out  of  a total 
of  32  failed  to  obtain  a degree,  whereas  only  13  of 
191  marrieds  were  nonrecipients. 

(2)  The  fifth  split  (single  population)  was  made  on  volun- 
teer status.  Of  the  11  single  students  who  were  AFIT 
volunteers,  none  failed  to  obtain  a degree.  Thus,  10 
of  the  21  single  nonvolunteers  were  nonrecipients 

*0nly  the  first  five  splits  are  presented  because  no  additional  insight 
was  gained  from  splits  which  occurred  after. 
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Summary  Tree  for  Degree  Receipt/Nonreceipt  Prediction 


making  their  probability  of  degree  nonreceipt  .4762, 
or  nearly  50  percent.  Compared  to  the  probability 
of  no  degree  for  the  rest  of  the  population 
(13  ^ 202  = .0644),  this  makes  the  single  nonvolun- 
teer group  7.4  times  as  likely  to  not  receive  a 
degree.  This  interaction  between  single  and  nonvolun- 
I teer  status  prompted  the  creation  of  a new  predictor 

I variable,  single  nonvolunteer,  for  the  discriminant 

analysis. 

j (3)  The  married  population  was  split  second  and  on  GMAT-T 

j score.  Interestingly,  there  were  ^ married  students 

j who  took  the  GMAT  and  met  or  exceeded  the  500  point 

i eligibility  criterion  that  failed  to  attain  a degree. 

I All  the  married  students  who  did  not  graduate  either 

scored  below  500  on  the  GMAT  or  did  not  take  it  at  all. 

j 

’ Additionally,  a later  split  on  GRE-T  caused  a division 

based  only  on  whether  a student  did  or  did  not  take 
the  GRE.  These  two  splits  caused  speculation  as  to 
whether  the  act  of  taking  a test  could  be  even  more 
significant  than  the  scores  achieved  by  these  subjects. 
Therefore,  two  new  predictor  variables , the  number  of  tests  taken 
and  whether  or  not  a test  was  taken  at  all,  were  created. 

These  variables,  like  volunteer  status,  are  considered  to 
be  additional  surrogate  measures  of  motivation.  The 
number  of  test  taken  variable  further  provides  three 
levels  as  indicated  in  Table  VII. 
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TABLE  VII 


Number  of  Entry  Tests  and  Motivational  Level 


Number  of  Tests 

Motivation 

0 

Low 

1 

Moderate 

2 

High 

The  interpretation  of  the  AID  run  resulted  in  the  creation  of  three 
new  predictors,  single  nonvolunteer,  whether  or  not  a test  was  taken,  and 
number  of  entry  tests  taken.  In  the  next  section  of  this  chapter,  the 
results  of  the  discriminant  analysis  with  these  new  variables  included 
are  presented. 

Degree  Receipt/Nonreceipt  Prediction  With  Discriminant  Analysis 

This  section  represents  the  culmination  of  the  research  performed 
for  this  thesis.  In  it  is  presented  the  results  of  the  final  computer 
runs  that  were  performed  using  all  the  predictor  variables  thought  to 
potentially  provide  the  greatest  degree  of  predictive  power.  Six  predic- 
tors were  used:  (1)  student  was  or  was  not  a single  nonvolunteer, 

(2)  age,  (3)  time  since  receipt  of  undergraduate  degree,  (4)  whether  or 
not  an  entry  test  was  taken,  (5)  UGPA,  and  (6)  number  of  entry  examina- 
tions taken. 

There  are  two  parts  to  this  section.  The  first  deals  with  the 
results  of  the  discriminant  analysis  using  the  entire  subject  population 
(N  = 223,  degree  nonrecipients  = 23).  Because  the  outcomes  were  nearly 
identical  with  the  prior  probability  of  group  membership  based  on  either 
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size  or  equal  chance,  only  one  set  of  results,  that  based  on  size,  is 
discussed.  The  second  part  provides  an  analysis  of  the  output  of  the  run 
made  using  equal  sized  no-degree  (N  = 23)  and  randomly  selected  degree 
receipient  (N  = 23)  groups. 

Discriminant  Results  with  N = 223.  A summary  table  for  the  stepwise 
discriminant  analysis  based  on  the  maximum  Mahalonobis  distance  criterion 
is  provided  in  Table  VIII.  It  should  be  stated  that  the  stepwise  solu- 
tion "...is  only  optimal  (rather  than  maximal)  because  not  every  possible 
subset  is  considered.  The  assumption  is  that  the  stepwise  procedure  is 
an  efficient  way  of  approximately  locating  the  best  set  of  discriminating 
variables."  (Nie,  et  al.,  1975:448) 


TABLE  VIII 

Discriminant  Analysis  Summary  (N  = 223) 


Predictor 

Partial 

F 

Wilks' 

Lambda 

Signifi- 

cance 

Change  in 
RAO's  V 

Signifi- 

cance 

Single  nonvolunteer 

40.97 

.844 

.000 

40.97 

.000 

Took  at  least  one  test 

10.39 

.806 

.000 

12.37 

Age 

3.51 

.793 

.000 

4.40 

.036 

A brief  description  of  the  column  meanings  is  provided  here  to  aid  in 
the  interpretation  of  the  table.  The  partial  F value  is  used  to  "...test 
for  the  statistical  significance  of  the  amount  of  centroid  separation 
added  by  this  variable  above  and  beyond  the  separation  produced  by  the 
previously  entered  variables."  (Nie,  et  al.,  1975:453).  The  Wilks' 

Lambda  statistic  is  used  to  measure  the  overall  separation  based  on  the 
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variables  in  the  equation  at  each  step,  and  an  approximate  F test  of 
significance  is  provided  (Nie,  et  al.,  1975:447,463).  The  Rao's  V sta- 
tistic is  a generalized  distance  measure  that  provides  the  greatest 
overall  separation  of  the  groups  based  on  that  variable  which  contri- 
butes the  largest  V increase  when  added  to  the  previous  variables  (Nie, 
et  al.,  1975:448,463).  The  test  of  significance  of  the  change  in  V is 
performed  using  the  statistic  (Nie,  et  al.,  1975:448). 

Additionally,  the  standardized  discriminant  function  coefficients 
are  given  in  Table  IX.  The  standardized  form  is  used  because 

"...each  coefficient  represents  the  relative  contri- 
bution of  its  associated  variable  to  that  function. 

The  sign  merely  denotes  whether  the  variable  is 
making  a positive  or  negative  contribution."  (Nie, 
et  al .,  1975:443). 


TABLE  IX 

Standardized  Discriminant  Function  Coefficients  (N  = 223) 


Predictor 


Degree  Receipt  Function  Coefficient 


Single  nonvolunteer 
Took  at  least  one  test 
Age 


-.976 

.502 

-.287 


The  implications  of  these  results  are  tremendous.  The  selection 
criteria  used  by  AFIT  Admissions  truncates  from  the  population  those  stu- 
dents who  scored  poorly  on  the  GRE  or  GMAT  and  whose  UGPA  was  not  fairly 
close  to  the  2.5  minimum  or  higher.  The  fact  that  no  ability  measures 
were  used  to  predict  degree  receipt  or  nonreceipt  indicates  that  the 
abi 1 ity  measures  used  by  AFIT  are  appropriate  but  not  sufficient  for 
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predicting  success.  The  biographic  and,  especially,  the  motivational 
predictors  which  were  selected  are  also  important.  The  first  variable 
entered  indicates  a highly  negative  relationship  between  degree  receipt 
and  single  nonvolunteer  status.  The  degree  group  contains  only  5.5 
percent  single  nonvolunteers,  whereas  43.5  percent  of  the  no-degree 
group  are  single  nonvolunteers,  and  the  difference  between  the  means  was 
found  to  be  highly  significant.  The  "took  at  least  one  test"  variable 
shows  a positive  relationship  with  degree  receipt.  Of  the  "success" 
group,  89  percent  took  at  least  one  test  while  only  60.9  percent  of  the 
"failures"  accomplished  the  same.  Again,  the  difference  between  the  means 
was  found  to  be  very  significant.  Age  is  negatively  related  to  degree 
receipt,  but  the  difference  between  the  means  is  not  significant  when 
age  is  used  alone.  The  interaction  between  volunteer  status,  whether  a 
test  was  taken,  and  age  must  be  considered  for  age  to  be  a meaningful 
predictor.  The  test  used  to  determine  the  significance  of  mean  aif- 
ferences  is  described  in  Appendix  0,  and  the  results  for  all  the  predic- 
tors examined  are  presented.  I 

j 

The  predictive  power  of  the  three  variables  can  be  better  visualized 
by  referring  to  the  classification  results  table  (Nie,  et  al.,  1975:457), 

Table  X.  This  table  shows  the  percentages  of  students  correctly  classi- 
fied into  each  group. 

Most  noteworthy  is  the  fact  that  43.5  percent  of  the  degree  non- 
recipients were  identified,  yet  only  5.5  percent  of  the  successful  students 
were  done  the  "injustice"  of  being  identified  as  "failures."  It  could 
be  argued  that  simply  predicting  success  for  al 1 students  meeting  the 
eligibility  criteria  would  have  resulted  in  an  89.7  percent  (200  success 


TABLE  X 

Classification  Results  Table  (N  = 223) 


Predicted 

Degree  Receipt 

Predicted 

Degree  Nonreceipt 

Actual 

Degree  Receipt 

94.5% 

5.5% 

Actual 

Degree  Nonreceipt 

56.5% 

43.5% 

Overall 

89.2%  Correctly  Classified 

divided  by  223  total)  correct  classification,  but  this  does  nothing 
j toward  reducing  the  number  of  nonsuccessful  students,  the  stated  purpose 

j of  this  study.  However,  to  further  investigate  the  power  of  motivational 

1 predictors,  one  final  computer  run  with  equal  populations  was  accomplished 

and  is  reported  on  in  the  next  part  of  this  section. 

Discriminant  Results  with  N = 46.  The  total  sample  consisted  of  the 
I 23  degree  nonrecipients  and  23  randomly  selected  degree  recipients  so  that 

predicting  success  for  this  entire  group  would  result  in  a correct  classi- 
fication of  only  50  percent.  The  results  of  the  discriminant  analysis  are 
shown  in  Table  XI. 

TABLE  XI 


Discriminant  Analysis  Results  (N  = 46) 


! 

Predictor 

Standardized 

Discriminant 

Function 

Coefficient 

Partial 

F 

Wi 1 ks ' 
Lambda 
(Signifi- 
cance) 

Change  in 
RAO's  V 
(Signifi- 
cance) 

# of  Tests  Taken 

.694 

4.91 

.900 

4.91 

i 

(.032) 

(.027) 

The  number  of  tests  taken  has  a positive  relationship  with  degree 
receipt  and  indicates  that,  again,  success  is  predicted  based  on  a sur- 
rogate motivational  measure.  The  results  of  the  significance  tests  for 
group  mean  differences  are  provided  in  Appendix  0,  and  indicate  that  the 
number  of  tests  taken  is  a significant  predictor. 

The  classification  results  are  presented  in  Table  XII.  The  overall 
I correct  classification  of  students  is  60.9  percent,  a 10.9  percent  gain 

^ over  that  obtained  by  identifying  all  46  students  as  degree  recipients, 

and  a noteworthy  increase  considering  that  only  one  predictor  is  utilized 
( for  classification. 

TABLE  XII 


Classification  Results  Table  (N  = 46) 


1 

Predicted 

Degree  Receipt 

Predicted 

Degree  Nonreceipt 

Actual  Degree  Receipt 

S2.6% 

17.4% 

Actual  Degree  Nonreceipt 

60.9% 

39.1% 

Overall 

60.9%  Correctly  Classified 

The  classification  percentages  within  the  table  are  noticeably  differ 
ent  from  those  using  the  entire  population,  but  this  is  to  be  expected 
because  the  characteristics  of  the  randomly  selected  successes  are  not 
identical  to  those  of  the  entire  population.  What  is  important  is  the 
fact  that  39.1  percent  of  the  degree  nonrecipients  were  identified  using 
a motivational  predictor  as  were  those  employed  for  the  total  population 
while  misclassifying  only  17.4  percent  of  the  successes,  and  with  a 10.9 
percent  improvement  over  pure  chance  categorization. 
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Summary 

This  chapter  has  provided  the  results  of  the  analyses  conducted. 
Three  topics  were  discussed:  (1)  GGPA  prediction  with  multivariate  re- 
gression analysis,  and  degree  receipt/nonreceipt  prediction  with  (2)  AID 
and  (3)  discriminant  analysis. 

The  fourth  and  final  chapter  presents  the  conclusions  arrived  at 
and  recommendations  made. 
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IV.  CONCLUSIONS  AND  RECOMMENDATIONS 


This  research  was  conducted  to  investigate  the  prediction  of  success 
among  Systems  Management  and  Operations  Research  Master's  degree  students. 

A total  population  of  223  male  USAF  officers  who  attended  AFIT  from  1971 
through  1976  was  analyzed.  Graduate  6PA  prediction  was  investigated 
using  multivariate  regression  analysis,  and  success  based  on  degree  re- 
ceipt or  nonreceipt  was  examined  through  the  application  of  the  Automatic 
Interaction  Detection  algorithm  and  discriminant  analysis.  Based  on  the 
results  of  the  study,  the  conclusions  arrived  at  and  recommendations  which 
are  made  are  presented  below.  The  list  of  abbreviations  provided  in 
Appendix  A will  aid  in  the  interpretation  of  this  chapter. 

Conclusion  1 . Decreasing  the  homogeneity  of  the  group,  that  is, 
combining  students  majoring  in  different  fields  of  study,  decreases  the 
6GPA  predictive  power  of  the  independent  variables. 

Recommendation  1.  Students  in  different  disciplines  should  not  be 
combined  for  GGPA  predictive  purposes. 

Conclusion  2.  For  the  combined  population  of  the  50  GSM  and  GOR 
students  who  took  both  the  GRE  and  the  GMAT,  the  GMAT  quantitative  score 
proved  to  be  the  best  predictor  of  GGPA  of  all  the  variables  examined  by 
far. 

Recommendation  2.  Consideration  should  be  given  to  the  use  of  the 
GMAT  for  the  satisfaction  of  eligibility  requirements  provided  GGPA  predic- 
tion is  the  criterion  of  success  which  is  used. 

Conclusion  3.  Even  when  GGPA  prediction  is  undertaken  using  groups 
with  a high  degree  of  homogeneity,  the  amount  of  predictive  power 
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achieved  is  modest.  Thus,  the  use  of  GGPA  as  a criterion  is  of  limited 
value,  and  in  fact  does  not  necessarily  determine  the  successful  comple- 
tion of  a graduate  program  by  a student. 

Recommendation  3.  The  use  of  a more  meaningful  success  criterion 
than  GGPA  is  recommended.  The  dichotomous  degree  receipt/nonreceipt  cri- 
terion provides  an  excellent  measure  of  success. 

Conclusion  4.  The  measures  of  ability  used  by  AFIT  admissions 
(Chapter  I,  AFIT  Eligibility  Criteria)  are  appropriate  for  determining  if 
a prospective  student  is  capable  of  completing  the  program,  but  do  not 
measure  how  motivated  he  is  toward  receiving  his  degree. 

Recommendation  4.  AFIT  Admissions  should  continue  to  use  the  tradi- 
tional ability  measures  as  eligibility  criteria,  but  should  further  con- 
sider surrogate  motivational  measures  as  an  aid  in  determining  if  appro- 
priate action  could  reduce  the  "failure"  rate.  Suggested  measures  and 

] 

actions  are  presented  in  the  following  paragraphs. 

Conclusion  5.  The  best  predictor  of  degree  nonreceipt  is  single  i 

nonvolunteer  status,  nonvolunteer  being  a surrogate  measure  of  motivation.  I 

Recommendation  5.  An  intrinsically  motivated  student  is  more  likely  j 

to  succeed  than  one  with  equal  ability  but  little  determination.  In- 
trinsic motivation  can  be  heightened  through  proper  extrinsic  methods, 
and  this  approach  was  used  in  determining  the  two  recommendations  that 
fol low; 

(a)  The  nonvolunteer  population  could  be  reduced  by  increasing 
the  AFIT  recruitment  effort.  Many  Air  Force  officers  are 
not  aware  of  the  numerous  AFIT  programs  available  and  the 
advantages  that  an  advanced  degree  can  provide.  It  is 
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recognized  that  additional  funds  would  be  required  for 
this  effort,  but  the  savings  in  on-the-job  man-hours  lost 
for  only  one  or  two  students  who  attended  AFIT  merely 
because  they  were  centrally  identified,  lacked  motivation, 
and  did  not  receive  a degree  could  offset  the  additional 
costs. 

(b)  Members  of  the  single  nonvolunteer  (centrally  identified) 
group  could  be  further  examined  for  degree  of  motivation. 

This  could  be  accomplished  by  letter,  telephone,  or  per- 
sonal interview  (possibly  through  the  prospective  student's 
Base  Education  Office).  A possible  format  is:  (1)  con- 
gratulate him  on  his  selection,  (2)  describe  the  good  and 
bad  aspects  of  the  program,  (3)  inform  him  of  the  advan- 
tages of  program  completion,  (4)  warn  him  of  the  potential 
consequences  of  "failure,"  (5)  assure  him  that  there  is 
absolutely  no  stigma  attached  to  declining  the  educational 
opportunity,  and  (6)  have  him  verify  that  he  has  a strong 
desire  to  obtain  the  degree.  In  this  way  the  fact  that  the 
single  nonvolunteer  is  7.4  times  more  likely  than  all  other 
students  to  not  receive  a degree  need  never  be  mentioned. 

Conclusion  6.  Whether  or  not  a prospective  student  took  a graduate 
aptitude  test,  like  volunteer  status,  is  a surrogate  measure  of  motiva- 
tion, and  is  positively  related  to  degree  attainment. 

Recommendation  6.  Practically  all  of  the  students  centrally  identi- 
fied by  the  supplemental  boards  (Appendix  B)  do  not  have  adequate  time  to 
take  the  GRE  or  GMAT,  and  thus  can  accept  the  nominations  with  no  effort 
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on  the  students'  part.  Volunteers  and  "first  round"  centrally  identified 
students  must  take  one  of  the  two  tests  before  their  acceptance  is  final- 
ized. Increasing  the  number  of  students  selected  for  AFIT  further  above 
the  quota  than  is  presently  practiced  and  placing  the  additional  selectees 
on  the  "alternate"  list  would  have  two  advantages.  First,  a greater 
number  of  selected  potential  AFIT  students  would  be  required,  at  their 
own  expense  and  on  their  own  time,  to  take  the  GRE  or  GMAT,  Second, 
the  supplemental  boards  would  be  required  to  select  fewer  students,  or 
would  not  have  to  meet  at  all.  Those  excess  alternate  selectees  who  meet 
the  eligibility  requirements  could  be  assured  of  being  primary  during  the 
next  selection  cycle. 

Suggestions  for  Further  Research 

This  study  has  blended  together  statistical  analysis  and  behavioral 
science  in  an  effort  to  predict  academic  success,  and  the  results 
achieved  suggest  several  interesting  possibilities  for  further  investi- 
gation. 

The  measurement  of  motivation  in  a civilian  institution  for  inclu- 
sion as  success  predictors  presents  some  novel,  but  not  insurmountable, 
problems.  Several  possible  measures  could  be  examined:  (1)  Is  the  stu- 
dent paying  his  own  way  through  college?  (2)  Is  he  on  a scholarship? 

(3)  Does  he  have  well  established  career  intentions  for  which  the  degree 
is  essential? 

Further  validation  of  the  findings  presented  in  this  thesis  would 
also  be  worthwhile  if  applied  to  widely  differing  fields  of  study  such 
as  Physical  Education,  Psychology,  and  Nuclear  Physics. 
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Looking  Back--and  Ahead 

This  study  was  performed  through  the  use  of  several  concepts  rarely 
combined  for  a task  as  seemingly  mundane  as  predicting  academic  success. 
However,  wherever  people  are  involved  the  inherent  uncertainties  neces- 
sitate scrutiny  from  as  many  vantage  points  as  possible. 

If  the  number  of  nonsuccessful  students  is  in  fact  reduced  through 
the  implementation  of  the  recommendations  presented,  the  goal  of  this 
research  has  been  achieved. 


! 
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List  of  Abbreviations 


AERORATED  - possess  a USAF  aeronautical  rating  (pilot,  navigator,  etc.) 

AFIT  - Air  Force  Institute  of  Technology 

AFITVOL  - volunteer  for  AFIT 

AFSC  - Air  Force  Specialty  Code 

AGE  - age  at  AFIT  entry 

AID  - Automatic  Interaction  Detection  algorithm 

GGPA  - graduate  grade  point  average 

GMAT  - Graduate  Management  Admission  Test 

GMAT-Q  - GMAT  quantitative  score 

GMAT-T  - GMAT  total  score 

GMAT-V  - GMAT  verbal  score 

GOR  - AFIT  graduate  Operations  Research  program 

GPA  - grade  point  average 

GRADTIME  - time  since  receipt  of  Bachelor's  degree 

GRE  - Graduate  Record  Examination 

GRE-Q  - GRE  quantitative  score 

GRE-T  - GRE  total  score 

GRE-V  - GRE  verbal  score 


GSM  - AFIT  Graduate  Systems  Management  program 

MILACAD  - attended  Annapolis,  West  Point,  or  the  USAF  Academy 
MPC  - USAF  Military  Personnel  Center 

SIE  - self-initiated  elimination 


SINGLE  NONVOL  - unmarried  nonvolunteer  for  AFIT 


SPSS 

TEST 

TEST-Q 

TEST-T 

TEST-V 

U-DEGREE 

UGPA 


- Statistical  Package  for  the  Social  Sciences 

- a compromise  aptitude  percentile  score  based  on  either 
the  GMAT  score,  the  GRE  score,  or  the  average  of  the 
two  if  both  tests  were  taken 

- TEST  quantitative  score 

- the  sum  of  the  TEST-Q  and  TEST-V  scores 

- TEST  verbal  score 

- undergraduate  degree  not  in  engineering,  mathematics, 
or  a physical  science 

- undergraduate  grade  point  average 
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APPENDIX  B 


USAF  Advanced  Academic  Degree  Management  System 

The  process  begins  at  the  Headquarters,  USAF  Office  of  the  Deputy 
for  Personnel  with  a determination  by  Air  Force  Specialty  Code  (AFSC) 
of  the  number  of  people  required  to  fill  forecasted  quotas.  From  the 
AFSC's  identified  educational  requirements  are  determined  and  the  number 
of  students  to  be  selected  for  each  AFIT  course  of  study  is  set.  Among 
this  number  are  the  sizes  for  each  GOR  and  GSM  Master's  degree  class  for 
a given  fiscal  year. 

Next,  those  officers  suitable  for  AFIT  educational  programs  based 
on  academic  background,  quality  of  military  record,  and  compatibility  of 
the  program  with  the  officer's  career  progression  pattern  are  selected  at 
the  USAF  Military  Personnel  Center  (MPC)  or  by  the  AFIT  Director  of 
Admissions  from  his  personnel  file,  and  are  termed  "centrally  identified." 
These  officers  must  also  be  available  for  reassignment.  The  availability 
requirement  is  two  years  minimum  since  last  permanent  change  of  station, 
or  completing  a controlled  tour  of  duty,  as  applicable.  Officers  with 
aeronautical  ratings  must  have  additionally  completed  five  years  of  rated 
duty. 

Eligibility  for  AFIT  is  determined  by  the  AFIT  Directorate  of 
Admissions.  Volunteers  and  centrally  identified  personnel  must  meet 
three  requirements: 

(1)  an  undergraduate  cumulative  GPA  of  at  least  2. 5/4.0 

(2)  a minimum  score  of  500  on  the  GMAT  total  or  on  both  the  GRE-V 
and  GRE-Q 
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(3)  previous  experience  which  indicates  an  ability  to  affectively 
learn  and  use  the  AFIT  education  for  the  good  of  the  Air  Force. 
Tradeoffs  between  these  requirements  are  permitted  as  described  in 
Chapter  I.  Of  the  volunteers,  approximately  25  percent  are  deemed  elibible, 
while  only  eight  percent  eligibility  is  common  for  centrally  identified 
officers  (Lillie,  1977). 

After  those  candidates  who  are  eligible  are  determined,  MFC  is  noti- 
fied. The  list  of  eligibles  is  then  considered  by  a Resource  Manager 
Team  which  consists  of  representatives  for  each  potentially  gaining  and 
losing  AFSC.  Each  eligible  is  voted  on  using  a yes/no  basis  until  the 
quota  is  overfilled  by  up  to  approximately  35  percent  or  the  list  of 
candidates  is  expended.  The  overfill  is  used  in  an  attempt  to  fill  quotas 
if  eligibles  are  not  ultimately  selected  for  AFIT  or  decline  the  nomina- 
tion. 

The  eligibles  approved  by  the  Resource  Manager  Team  are  then  con- 
sidered by  the  AFIT  Selection  Board  at  MFC.  The  Board  consists  of  three 
colonels:  the  Chief  of  the  Rated  Officer  Assignments  Branch,  the  Chief 
of  the  Support  Officer  Assignments  Branch,  and  the  Deputy  Chief  of  the 
Utilization  Policy  Division.  In  considering  each  eligible  they  review 
Career  Briefs  and  Selection  Folders  to  determine: 

(1)  promotability 

(2)  utilization  following  AFIT  education 

(3)  how  to  resolve  differences  of  opinion  between  Resource 
Managers,  if  necessary. 

Again  a yes/no  vote  is  taken,  and  those  candidates  receiving  at  least 
two  "yes"  votes  become  selectees,  subject  to  the  approval  of  the  USAF 
Deputy  Chief  of  Staff  for  Military  Personnel. 
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Approved  selectees  are  then  notified  and  either  accept  or  decline 
the  nomination.  If  the  number  of  selectees  accepting  falls  below  the 
quota,  supplemental  boards  are  held  to  identify  additional  selectees. 

In  this  case  it  is  frequently  necessary  for  AFIT  Admissions  to  determine 
the  eligibility  of  candidates  using  no  GRE  or  GMAT  input  because  the 
candidate  has  had  insufficient  time  to  take  the  examination.  Addition- 
ally, the  selectee  is  under  a great  deal  of  pressure  to  rapidly  make  a 
decision  which  could  have  a tremendous  impact  on  the  remainder  of  his 
Air  Force  career. 

After  acceptance  or  rejection  is  received  by  MPC  from  the  supple- 
mental selectees,  the  AFIT  selection  process  for  a given  fiscal  year  is 
complete.* 


*A11  the  information  in  this  appendix  was  provided  in  March  1977  by 
Lt  Col  Gerald  C.  Malicki  of  the  AFIT  Directorate  of  Admissions  except 
where  referenced  otherwise. 
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GGPA  UGPA  AGE  GRADTIME  MILACAD  U-DEGREE  SINGLE  AFITVOL 


GGPA  UGPA  AGE  GRAD-  MILACAD  U-  SINGLE  AFIT-  AERO-  TEST-V  TEST-Q 

TIME  DEGREE  VOL  RATED 


6GPA  UGPA  AGE  MILACAD  U-  SINGLE  AFIT-  AERO-  GRE-V  GRE-Q  GRE-T  GMAT-V  GMAT-Q 

DEGREE  VOL  RATED 


The  t Test  for  Differences  Between  Means 
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The  t Test  for  Differences  Between  Means* 

Are  the  differences  between  sample  means  statistically 
significant? 

Hq  : Ui  - U2  = 0 

u = true  mean 

Ha  : Ui  - Mz  > 0 

of  significance  of  .05,  reject  Hq  if  t > t ^ + p^_2 

Xi  - X2  - 0 

V n^  + n^  - 2 Vnj  nz 

Xi  = sample  mean;  i^^  sample,  i =1,  2 
Si^=  sample  variance;  i^*^  sample,  i = 1,  2 
ni  = sample  site;  i^^  sample,  i = 1,  2 

lis  test  evaluates  the  significance  of  the  difference  between 
mfans  for  the  variable  taken  alone.  The  discriminam;  analysis  signifi- 
cance tests  consider  the  significance  of  a variable  in  conjunction  with 
all  variables  previously  entered  into  the  analysis.  Thus,  predictor  group 
mean  differences  could  fail  to  achieve  significance  using  this  test,  and 
yet  be  significant  in  the  discriminant  function, 
i 


Question: 

) 

i 

I 


At  a level 


where 


and 


Caveat: 


Tests  Based  on  the  Total  Population 

(1 ) Single  Nonvolunteer  Group  Mean  Difference  Test  (N  = 223) 

X 1 = .435  Hq  : u j - ijj  = 0 

X2  = .055  Hg  : Uj  - ^2  ^ 0 

~ .257  Reject  Hq  if  t > 1.645 

si  = .052 

i ni  = 23 

■ n^  * 200 

T.  0 5,  22  1 ~ 1 .645 

® .435  - .055  - 0 

^ 1 /(22)  (.257)  + (199)  (.052)~^  ^ /T  . ~ jJ 

\l  221  \/23  200 

I t = 6.413  > 1.645,  therefore  reject  Hq 


The  Means  are  Different 

(2)  Took  at  Least  One  Test  Group  Mean  Difference  Test  (N=223) 


1 = 

.890 

Ho  : - 

^2  = 

0 1 

2 ~ 

.609 

Ha  : - 

^2 

0 i 

2 _ 

I 

.098 

i 

Reject  Hq 

if  t 

>1.645  j 

2 _ 

2 

.249 

1 

ni  = 200 

n^  = 23 
t „ =1 .645 

.05,221 

.890  - .609  - 0 

t = 

-V  /(199)(.098)  + (22)(.249rn  / 1 . 1 ' 

V 25l  V 200  I3 

t = 3.799  > 1.645,  therefore  reject  Hq  The  means  are  different 
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V 


The  remaining  t test  results  provided  below  were  computed  using 


the  same  techniques  employed  previously. 


(3)  Age  Group  Mean  Difference  Test 
= 30.31 
Xj  = 30.30 
s*  = 12.89 
= 16.22 
ni  = 200 

nz  = 23 


(N  = 223) 

Ho  : Uj  - Uz  = 0 
Ha  : Ui-  Uz  > 0 

Reject  Hq  if  t > 1 .645 
t = .013 

Cannot  say  that  the  means 
are  different 


(4)  Time  Since  Receipt  of  Undergraduate  Degree  Group  Mean  Difference 
Test  (N  = 223) 

Xj  = 7.06  Ho  : Ui  - = 0 

Xj  =6.87  Ha  : Ml  - > 0 

s^  = 10.05 

Reject  Ho  if  t > 1 .645 

s,^  = 12.94 
2 

n^  =200  t = .269 

r\2  = 23 

Cannot  say  that  the  means 
are  different 
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Xi  = 1 . 1 30  Hq  : Ui  - 

Xj  = .696  Hg  : > 0 

s.^  = .335 

t = 3.371 


Tests  Based  on  the  Reduced  Population 


(1 ) Number  of  Tests  Taken  Group  Mean  Difference  Test  (N  = 46) 

Hq  : Uj  - Uj  = 0 
: Ui  - U2  > 0 

Reject  Hq  if  t > 1 .681 

n = = 23  t = 2.212 

(Group  1 = "success") 

The  means  are  different 

(2)  Single  Nonvolunteer  Group  Mean  Difference  Test  (N  = 46) 


Xi  = .435 

Hq  : Ml  - U2  = 0 

II 

ro 

Hg  : Uj  - > 0 

sf  = .257 

s^  = .178 

Reject  Hq  if  t > 1 .681 

nj  = n2  = 23 

t = 1.585 

(Group  1 * "failure") 

Cannot  say  that  the  means 

are  different 

(3)  Age  Group  Mean  Difference  Test  (N  = 46) 


Xj=  30.304 
X2=  29.826 

Sj2=  16.221 

s/=  17.059 

nj  = n^  = 23 

(Group  1 * "failure") 


Hq  : u,  - U2  = 0 
Ha  : bi  - U2  > 0 

Reject  Hq  if  t > 1 .681 
t = .397 

Cannot  say  that  the  means 
are  different 
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(4)  Time  Since  Receipt  of  Undergraduate  Degree  Group  Mean  Difference 
Test  (N  = 46) 


Xi  = 6.870  Hq  : Uj  - Uj  = 0 

X2  = 6.087  Hg  : Uj  - Uj  ^ ® 

= 12.937 

Reject  Hq  if  t > 1.681 

si  * 11.265 

rij  = rij  = 23  t = .763 

(Group  1 = "failure")  Cannot  say  that  the  means 

are  different 


(5)  UGPA  Group  Mean  Difference  Test  (N  = 46) 


Xj  = 2.920 

Xj  = 2.888 

si  = .063 

$2^  = .161 
nj  = Oj  = 23 
(Group  1 = "success") 


Hq  : Uj  - U2  = 0 

Ha  : Ui  - Uj  > 0 

Reject  Ho  if  t > 1.681 
t = .324 

Cannot  say  that  the  means 
are  different 


(6)  Took  at  Least  One  Test  Group  Mean  Difference  Test  (N  = 46) 


Xi  = .826 

Ho  : Ui  - Uj  = 0 

Xj  = .609 

^^a  = Hi  ■ ^2  > 0 

si  = .150 

S2^  = .249 

Oj  = Oj  * 23 

Reject  Hq  if  t > 1 .681 

t = 1.647 

(Group  1 = "success") 

Cannot  say  that  the  means 

are  different 
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